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I. Motivation 


The question whether reconstructing the shape of an opaque object by measuring 

» 

the light it reflects is possible was raised in Horn’s thesis [HO70]. He will 
refer to this as the shape from shading problem. He observed that under certain 
assumptions (which we will discuss in the next section), first order partial 
differential equations describe the relation between the brightness of a small 
patch of an object and the local surface normal. In other words we can determine 
the shape of an object by solving a first order partial differential equation 
(abbreviated in the following by (FO)PDE), also referred to as the Image 
Irradlance equation . 

The I iterature about PDE’s is extensive, but the emphasis is on higher order 
PDE’s. As the majority of physical phenomena can be formulated as second order 
POE’s, these equations have been studied the most. 

In this paper we are going to study FOPDE’s. Ue try to summarize the various 
known results and describe methods for solving a given FOPDE. At the same time 
we keep in mind that the equations describe a physical situation and therefore 
their solutions have to make M sense”• A major problem is that the mathematical 
literature deals nearly exclusively with equations and their solutions which are 
continuous and have continuous derivatives in all their variables. But "real” 
objects have edges and there the surface normals are discontinuous. Another 
problem are occluding contours in the pictures as there the partial derivatives 
of the function describing the surface are discontinuous. 

It is intuitively "clear" that if the FOPDE is discontinuous in some of its 
variables, we can expect solutions which have discontinuous derivatives. The 
question arises if we can have such solutions also if the equation itself is 
continuous. Is it possible for example that an object has an edge without the 
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equation reflecting this fact. The answer is yes and we will examine why and how 
this can happen. Ue will show that in this case initial conditions are going to 
reflect the discontinuity. 

In general, a POE describes a class of processes and not a a particular 
instance of one of them. Consider as an example the Laplace equation 

Af * 0 

where A denotes the Laplace operator and f a vectorfield. Then the PDE tells us 

that the field f has no sources and zero curl. But there are a lot of fields 

» 

which fall in this category. Only when we specify some more conditions about f 
can we determine the unique solution of the equation. 

We will study what kind of constraints are necessary to pin down a unique 
solution of a given image irradiance equation. An attempt will be made to find 
constraints which are accessible, i.e., which can be measured. 

II. Th e sh ap e f rom s hading problem revisited 

There are basically three components to this problem which we have to 
understand. They are the lightsource, the object and the viewer. 

The exposure of film in a camera (for fixed shutter speed) is proportional to 
image irradiance, the flux per unit area falling on the image plane* Similarly, 
grey levels measured in a electronic imaging device are quantized measurements of 
image irradiance. It can be shown that image irradiance in turn is proportional 
to scene radiance, the flux emitted by the object per unit projected surface area 
per unit solid angle [H0S78J. The factor of proportionality depends on to 
details of the optical system including the effective f-number. 
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Scene radiance depends on the 

1) surface material and its microstructure, 

2) the distribution of light source, and, 

3) the orientation of the surface* 

Consider a viewer-oriented coordinate system with the viewer located far above 
the surface on the z-axis. If the objects imaged are small compared to their 

distance from the viewer, one can approximate the imaging situation by an 
orthographic projection, 

x’ * x(f/z 0 ) y f * y{f/z 0 ) 

where (x’,y f ) are the coordinates of the image of a point (x,y f z) made with a 

system of focal length f, when the viewer is at distance z 0 above the origin* Ue 
assume that (x^ + y^ + z^) z 0 ^. 

The orientation of a patch of the surface can be specified by given its 

gradient (p,q), where p and q are the first order partial derivatives of z with 
respect to x and y. For a particular surface material and a particular 

distribution of light sources, scene radiance will depend only on surface 
gradient. This function, R(p,q), (or a contour representation in gradient 

space), is called the reflectance map. 

11 L(x,y) in the scene radiance calculated form the observed image irradiance 
at the point (x’,y*) in the image then 

R(p,q) « L(x,y) (2.2) 

where (p,q) is the gradient at the corresponding point on the object being 
imaged. This equation is called the image irradiance equation. It is clearly a 
first order partial differential equation since it involves only the partial 
derivatives p and q and the coordinates x and y. 

A word of caution: we are not dealing with several issues like mutual 
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illumination, shadows and specularity. 

III. Basics 

For simplicity of exposition we will only deal with partial differential 

equations involving a function z of two variables x and y. It is more or less 

"obvious" how to generalize the results to functions of n variables. Ue will 

denote z and z - the partial derivatives of z with respect to x and y - by p 
x y 

and q respectively. Then the relation 

F(x,y,z,p,q) * 0 (3.1) 

is called a first order partial differential equation. A function z(x f y) is 
called a solution of (3.1) if in some region of the x-y plane the function and 
its derivatives satisfy the equation identically in x and y. Such a function is 
also called an integral surface. 

When solving a partial differential equation we want to find the "general” 
solution which is a whole "set" of solutions. By imposing some additional 
constraints we can find the particular solution in which we are interested. Such 
constraints can be for example boundary conditions or initial values. In a later 
section we will state precisely what we mean by a "general" solution and what 
kind of constraints are necessary to pin down the desired solution. 

The relation (3.1) is a linear PDE if it is linear in z, p and q with 
coefficients depending only on x and y and (3.1) i9 quasi-linear if it is linear 
in p and q with coefficients depending on x, y and z. 

Unless otherwise stated we will assume that F, z and all relevant derivatives 


exist and are continuous. 
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He will first consider this special POE as its geometric interpretation is 
rather clear and so the relevant method for solving it can be explained and 
understood easi ly. In this case the relation (3.1) can be rewritten as 

a (x, y, z) p + b(x,y,z)q = c(x,y,z) (4.1) 

To rule out trivial cases we will further assume that 

a^ + x 0 

I4e will try to find solutions to (4.1) given implicitly by 

G(x.y.z) = 0 (4.2) 

Differentiating (4.2) with respect to x and y gives us 

G x + G Z 2 X " 0 and G y + G z z y = 0 (4.3) 

or equivalently 

z x - - G x /G z and z y - - G y /G z (4.3*) 

Using (4.3’) in (4.1) we get 

a(x,y,z)G x (x,y,z) + b(x,y,z)G y (x,y,z) + c(x,y,z)G z (x,y,z) - 0 (4.4) 

Note that in general (4.1) is a nonlinear POE for the function z(x,y) whereas 

(4.4) is a linear PDE for G(x,y,z). Ue can interpret the coefficients a(x,y,z), 
b(x,y, z), c(x,y,z) in (4.4) as the components of a vector field 
® « ®(x,y,z) = (a(x,y,z) ,b(x,y,z) ,c(x,y,z)J. 

Then we can rewrite (4.4) as 

<»,VG> = 0 (4.5) 

where VG denotes the gradient of G and < , > the inner product of two vectors. 

Ue know that at each point VG is perpendicular to the surface defined by 

G(x,y,z) and the equation (4.5) tells us that 91 is perpendicular to VG. Thus 91 
has to lie in the tangent plane of the integral surface defined by G(x,y,z). 

Let us introduce the notion of a fieldline of a vectorfield. By a fieldline 



we understand a curve whose tangent at every point has the direction of the 
fieldvector there. Then an integral surface can be built up from fieldlines 
(called charac ter i st i cs in this context) of the vectorfield To reiterate the 
previous statements: The tangent at each point of a characteristic has the same 
direction there as the vector and therefore by virtue of (4.5) the same 
direction as the tangent plane of the integral surface G(x,y,zK This does not 
mean that each quasi - I inear PDE has a single solution. Such a POE only 
constrains the possible orientations of the tangent planes at each point to a 
one-parameter manifold. As (4.1) is linear in p and q all feasible tangent 

planes at every point of an integral surface intersect in a line which is called 
the flange axis. Thus finding a solution to (4,1) means finding a surface which 
at each point has the direction of the flonge axis (the direction of the vector 
8t) as its tangent direction. 

Let us now describe a method of finding the characteristic curves, which can 
be written as functions of one parameter x«x(s) t y~y(s) and z*zlsK Then 

9 « 4 | 

£(s) « [x (s), y (s), z (s) 1 (where * denotes differentiation with respect to s) has the 
same direction as W and therefore the outer product of Jf(s) and ®f has to be 
zero. 

bz - cy = 0 

cx ~ az » 0 (4*6) 

ay - bx « 0 

The relation (4.6) is normally written as 

dx : dy : dz * a : b : c (4.7) 

The solutions of the equations (4,7) comprise a two-parameter family of curves 
in space (the charac ter i st i cs). I4e know that only a one-parameter subset of them 
generate the solutions of the PDE . To find this subset we introduce an 
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arbitrary function between the two free parameters we get solving (4.7). So the 

general solution of (4.1) contains an arbitrary function of one parameter. 

Now we are able to summarize all the previous stated results as follows: Each 

surface which is produced by a one-parameter family of characteristics is an 

integral surface. Conversely each integral surface is generated in such a 
fashion. 


Ihe first statement should be clear by now (otherwise this is 

"comprehensive" guide to first order PDE's). To understand the second, 
the following. 

On each integral surface z = z(x,y) the equations 


not a 
remark 


dx dy 

— = a (x,y,z) — = b(x,y,z) 

ds ds 

define a one-parameter family of curves: x = x(s) , y - y( s ) , z * z(x(s) ,y(s)). 
Note that on such a curve 


dz 

— = c (x, y, z) 
ds 


as 


dz dz dx dz dy 

= — + — — _ az ^ + _ c 
ds 8x ds 9y ds 


examp Ie : 


F(x,y,z,p,q) = xp + yq - z = 0 


Then the equations for the characteristics (4.7) are 

dx : dy : dz » x : y :z 

and have as their solution the two-parameter curves in space 
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y ■ Cix 

(*) 

z = C 2 x 

Now we introduce an arbitrary function w between the two constants? w(Cj) « C 2 
to find a one-parameter subset of (*) 

z y 

- ss C 2 = w(C^) = w(-) 

X X 

solution of the PDE : z = w(y/x)x 

or in parameter form : y * C^x and z » u(C^)x. 

V, Method of characteristics for general first order PDE’s 

Ue want to apply similar methods as developed in section IV to the genera! 
first order PDE 

F(x f y,z,p,q) * 0 (5*1) 

To exclude trivial cases we will assume that 

F 2 + F 2 * 0 

p q 

Our goal is to transform the problem of finding a solution to (5.1) to the 
problem of integrating a set of ordinary differential equations. Again 
geometrical reasoning will help us find these equations. 

Let us fix a point P with coordinates (x,y,z) on an integral surface. Then 
the quantities p and q are constrained by (5.1) to a one-parameter family of 
curves. [in other words; Once x, y and z are fixed, (5.1) is an equation for p 
and q. To write this equation in parameter form we only need one parameter.! As 
p and q determine the direction of the tangent plane at P, we have just 
established the fact that (5.1) constraints the feasible tangent planes to a one- 
parameter family. The envelope of the tangent planes is a conical surface and is 
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called flonge cone. This surface can have several sheets. Then "the 
considerat ions here refer merely to a suitable small range of tangent planes, 
e,g.» a portion of a sheet of the cone where q can be expressed as a single- 
valued differentiable function of p [C0HIG2)." Each generator of this cone 
represents a possible direction of the tangent plane at P and is called a 
characteristic direction. Thus the integral surface has to "fit" into the field 
of flonge cones. 

Recall now that in the quasi-! inear case the flonge cone degenerated to the 
flonge axis, i.e. at every point the direction of the tangent plane was fixed. In 
that case we proceeded by finding characteristic curves which at every point had 
as their tangent direction the direction of the flonge axis there. He concluded 
that the integral surface is swept out by the characteristic curves. Actually we 
can do the same thing in the case of a general PDE, but we have to be a little 
more careful this time. First we find the curves which at every point have as 
their tangent direction the characteristic direction. Let such a curve (called 
focal curve) be given by x(s), y(s) and z(s). Remember that we are looking for 
curves which sweep out the integral surface z(x,y). In other words we want the 
functions x(s). y(s), z(s), p(s) and q(s) to satisfy the PDE (5.1). The focal 
curves only determine x(s), y(s) and z(s) and (5.1) gives us only a relation 
between p and q. So we are one equation short in order to determine p and q. He 
will obtain this equation by forcing the focal curves to lie on the integral 
surface. The focal curves, which also satisfy this last condition are called 
characteristic curves. Again the characteristic curves sweep out the integral 
surface. 

Actually the problem we are concerned with is to find the integral surface. 
So we have to go the "opposite" way from what was described in the preceding 
paragraphs. He will first find a set of equations, called the characteristic 
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equations. A subset of the solutions of this set are the characteristic curves, 
from which the integral surface can be built up. 

In thq following paragraphs we are going to develop the technical "machinery" 

to find an integral surface of (5.1). 

Our first task is to find the equation of the Honge cone. So let us fix a 
point (x, y, z). Then we can write p and q - which satisfy (5.1) - as functions of 
a parameter u and all feasible tangent planes at (x,y,z) can be expressed as 

(Z-z) = (X-x)p(u) + (Y-y)q(u) (5.2) 

The envelope of the planes defined by (5.2) defines a conical surface with 

vertex at (x,y,z), the Monge cone. (aside: a conical surface is produced by 

moving a straight line which is fixed at one point along a curve). Ue get the 

equation of the flonge cone by eliminating u from (5.2) and (5.3) which is 

obtained by di f ferent i at ing (5.2) with respect to u. 

(X-x)dp (Y-y)dq 

0 --+- (5.3) 

du du 

Differentiating the POE (5.1) with respect to the parameter u we obtain 

dp dq 

0 , F — + F — (5.4) 

p q 

du du 


Assuming that neither dp and dq nor F and F q vanish identically we get from 
(5.2), (5.3) and (5.4) that 


X-x Y-y Z-z 

Fp F q pFp + qFq 


(5.5) 


By substituting all possible values for p and q (i.e. all values for p and q 
which satisfy (5.1) ) we obtain all generators of the Monge cone at the point 
(x,y, z). The generators of the Monge cone at the different points of the 
integral surface define the tangent direction of the focal curves. Therefore the 
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focal curves have to 


satisfy the following 
dx dy 



differentia 1 equations, 
dz 

" - pF p + qF q 

ds 


(5.6) 


Let z = z(x,y) be an integral surface on which we also know p and q. Then the 
equations 


dx 

dy 


— *= p 

p 

~ « F 

q 

(5.7) 

ds 

ds 



define a one-parameter family of curves. 
On these curves 


dz dx dy 


-nr Z-+ Z- 

X ^y 

ds ds ds 

(5.8) 


holds and using (5.7) in (5.8) we obtain 


dz 

- - PFp * 
ds 

(aside: The above condition is called strip condition. "It states that the 

functions x(s), y(s), z(s), p (s), q(s) not only define a space curve, but 

simultaneously a plane tangent to it at every point. A configuration consisting 

of a curve and a family of tangent planes to this curve '19 called a strip 
(C0HI62J."] 

So (5.8) states that the curves defined by (5.7) are focal curves. Non ue 
also require that a focal curve is embedded on an integral surface: ("By 
embedding ue mean that in the neighborhood of the projection of a focal curve on 
the x-y plane z is a single-valued, twice continuous differentiable function of x 
and y (COM 62)."] If ue differentiate the PDE (5.1) uith respect to x and y ue 
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get 


F D Px + F a% + F z p + F : 


F p p y + F q q y + F z q + F y " 0 


(5.9) 


Using (5.7) and the fact that p y * q x we get 


dp dx dy 

“ Px + Py c Px F p + ^x F q 
ds ds ds 


dq 


dx 


dy 


" - V- + q y" ‘ Py F p + q y F q 

ds ds ds 


(5.10) 


Using (5.9) in (5.10) we get 


dp 


- + F z p + F x = 0 


ds 


dq 

- + F z q + F y - 0 
ds 


(5.11) 


Ue can now summarize the previous results as follows; If a focal curve is 
embedded on an integral surface then along the curve the coordinates x.y.z and 
the quantities p and q satisfy the following five ordinary differential 
equations; 


dx dy 

__ = F p ~ - F q - r- p • -v q 

ds ds ds 


dz 

- - pF n + qF, 


(5.12) 


dp 


dq 


-(pF z + F x ) - = -<qF z + F y ) 


ds 


ds 


Let us now consider the system (5.12) by itself, i.e. disregarding that we 
obtained it with a given integral surface in mind. Note first that F(&*y,z*p*q) 
is constant along each solution of the system (5.12) as 
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" ■ F P (pF z + F x ) - F q (qF Z + V + F z ( P p p + <fq> + Vp + F/ q - 0 

Thus F(x,y,z,p,q) = constant is a solution of (5.12). The system of equations 
(5.12) defines a four-parameter family of solutions. By imposing the additional 
constraint that the solutions of (5.12) also satisfy the PDE (5.1) we obtain a 
three-parameter subset of the solutions, the characteristic strip. "A space 
curve x(s), y(s), z(s) bearing such a strip is called characteristic curve 

(C0HI62]. He have already established the fact that a one-parameter subset of 
the three-parameter family of curves sweeps out the integral surface. 

As characteristics depend on the solution, their range of influence cannot be 
determined in advance. 

In the next section we will discuss the notion of a complete integral and then 
we will show how to choose the appropriate one-parameter subset. 

So the problem of finding a solution to (5.1) is equivalent to integrating the 
system of five ordinary differential equations (5.12) which are also called the 
characteristic equations. 


VI. General solution and complete integral 

In the previous section we saw that each solution of a general first order PDE 
is swept out by a one-parameter family of curves. Thus the equation of an 
integral surface can be written as a function of the coordinates x and y and of 
an arbitrary function of one variable; such an equation is called the general 
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Let us now assume for a moment that we have a solution z ® ^(x,y,a,b) of the 
PDE which depends on two parameters* Then we say $(x,y,a,b) is a complete 
integral if 

^ 88 ^xa^yb ~ ^xb^ya 


is not equal to zero* This condition assures that $ realty depends on two 
parameter, i .e. that there is no a = g(a,b) such that $(x,y,a,b) * $(x,y,cx) . 

From the two-parameter family of planes defined by ^(x,y,a,b) we can choose a 
one-parameter subset by introducing an arbitrary function which relates a and b* 
e.g. set b » w(a) * Note that the family $(x,y,a,w(a)) is again a solution of 
the PDE . The following idea makes the concept of a complete integral 
significant: The envelope of the family $(x, y, a, w(a)) is again a solution of 
the PDE since at each point it touches a member of the family £(x,y,a,w la)) i*e* 
a solution. Or conversely each point of the envelope is a solution of the PDE . 
lie obtain the equation of the envelope by eliminating the parameter a from the 
two equations: 


z = $ (x, y, a, w (a)) 

(x,y, a, w(a)) + ^(x^y,a,w(a) )w’ (a) ® 0 


CG * 1) 


Eliminating the parameter a from (G.l) yields an expression involving an 
arbitrary function w of one variable, which is a solution to the PDE and 
therefore we have found the general solution. Ue will now exhibit this fact 
analytically. By di f ferent iating (G.l) with respect to x and y we get 


z x * *X + ( *a + *b M ’ {a))a x 

(G.2) 

z y * *y + <*a + ♦b uMa),a y 

Ue know that ♦ Cx.y.a. w(a)) is a solution for any choice of the parameter a. 
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Using (G.1) (i.e. * a + * b w’(a) = 


0) in (6.2) establishes the fact that for all x 


and y the values of z, z y and z are the same as those of + and 4 . ' 

y x 

So if we know the complete integral of a given PDE ue can obtain the general 
solution by just using the process of differentiation and elimination of 


parameters. (This later process can in practice be tedious or impossible, but is 

often not necessary, as by plugging in all different values for a, all solutions 

of the PDE are obtained.) The only problem uith the above described method is 

that there is no easy way to find a complete integral. In the next section we 

will show that uith the help of the characteristic equations we can find a 
complete integral. 


The general solution does not comprise all solutions of a PDE . The envelope 
of the complete integral, the so called singular integral, is again a solution 
which cannot be obtained from the general solution. The equation of the singular 

i 

integral, which does not contain any arbitrary elements, is found by eliminating 
the parameters a and b from the equations 


z = $(x,y,a,b) 

* a (x,y,a,b) - 0 (6.3) 

^ b (x,y,a,b) = 0 

Ue have assumed all along that all eliminations are possible and that during the 

course of this process ue obtain functions with continuous derivatives. 

Actually ue do not have to know the complete integral in order to find the 

singular solution. Note only that, for a complete integral, F(x,y,*,* ) 

x y 

vanishes identically for all choices of the parameters a and b. I f ue nou 
differentiate the PDE uith respect to a and b ue get 




As t is a complete integral, 0 = ♦xa^yb - ♦xb^ya ’ 8 no ^ ec l ua l to zero* 

Furthermore $ and are zero (equations (6,3) ) and therefore we get the 

equation of the singular integral from (6.4) by eliminating p and q from 

F = 0 F = 0 F = 0 (6.5) 

P q 

7 7 

[aside:we did not assume in this case that F D + F * 0 as we did when obtaining 

r H 

the characteristic equation,] 

If the POE does not contain the function z(x,y) explicitly then there exist no 
singular solution as in this case the complete integral is of the form 

z « $(x f y,a) + b 

and the condition 0^ = 0 can not be fulfilled. 

VH, Method for finding the complete integral 

In the previous sections we have shown two methods for finding the solutions 
to a given PDE . Now we will show how, with the help of the characteristic 

4 

equations, we can find a complete integral and this will also then be a way to 
find a one-parameter subset from the four-parameter family of solutions of the 
characteri st i c equations. 

First we have to discuss a special form of PDE called Pfaff’s equation. 

f(x,y f z)dx + g(x,y,z)dy + h(x,y,z)dz ® 0 (7.1) 

In the case when h 5 0 and f and g depend only on x and y (7.1) degenerates to 
an ordinary differential equation which is called an "exact" differential 


equation. 
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f(x,y)dx + g(x,y)dy = 0 (7.2) 

The equation (7.2) is called "total" if f and g satisfy the integrabi I i ty 
condition 

f y ( x.y) = g x (x,y) (7.3) 

In the case of a total differential equation it is easy to find a solution to 
(7.2). On each simply connected region we can find a function H(x,y) such that 

3H 3H 

— - f(x,y) and — - g(x,y) ( 7 . 4 ) 

dx 3y 

then 


dH = f(x,y)dx + g(x,y)dy 

and the equation dH = 0 is equivalent to (7.2). 

I 

Thus H(x,y) = constant is a solution to (7.2) and the function H can be found 
by integrating (7.4). 

In the case that (7.3) is not satisfied by the given equation (7.2) one can 
always introduce an "integration" factor M*,y) such that the equation 

Mfdx + jigdy » 0 ( 7 . 5 ) 

is total, i.e. that (jif) y = (#ig} y . Or equivalently (ilx.y) has to be a solution 
of the following PDE which can be solved with the method of characteristics. 

f»(fy - g x ) + f - t» x g = 9 

Now let us return to equation (7.1) which is again easy to 9 olve if its left 
hand side is a total differential of a function H(x,y,z) i.e. if 

3H 3H 3H 

f = — 9 = — h - — (7.G) 

3x 3y dz 

Necessary for (7.G) to hold is that 

9f 3g 3g 3h 3h 5f 

— ° — — - — — - — (7.7) 

3y 3x dz 3y 3x dz 

In a simply connected area (7.7) is also sufficient for the existence of a 
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function H(x,y,z) which satisfies (7.G) and can be.calculated as 

(x.y.z) 

H(x,y,z) = + gdy + hdz) + C 

( x o'Vo' ? o ) 

where t x g,yg,zg) is a fixed point. Clearly H(x,y,z) ■ constant is a solution to 


(7.1). 

In the case when (7.7) is not satisfied we again want to find an "integration" 
factor ji(x,y,zh such that the expression (ifdx + Mgdy + nbdz is a tota I 
differential of a function. In comparison to Pfaff’s equation in two variables 
it is not always possible to find such a factor. 

Necessary for ji to exist is that the following equation holds: 

f(g z - h ) + g(h x - f z ) + h(fy - g x ) «* 0 (7.8) 

It can also be shown (simple, but tedious) that in a simply connected region 
(7.8) is sufficient for (7.1) to possess a one-parameter family of solutions 
H (x, y, z) = constant. He will show now how to construct such a function H(x, y,z). 
First let us consider the "abbreviated" equation 

f(x,y,z)dx + g(x,y,z)dy ■ 0 (7.9) 

This is a Pfaff’s equation in the two variables x and y with z as a parameter. 
Thus we can always (eventually with the help of an integrating factor X(x.y.z) ) 
find a solution to (7.9): 


4>(x,y) = u(x,y,z) = C 


(7.10) 


Note that 

<3u 3u 

Xf = — and Xg *> -- 
3x 3y 

Now we define a function S depending on the three variables x,y and z by 


(7.11) 




9u 

S(x,y t z) « Xh ~ 

dz 

If we express - with the help of (7.10) - y as a function of x, u and 
redefine S as a function of x, u and z, i.e. 

T(x,u,z) = S(x,y,z) 

Ue will prove now that T is actually independent of x. Then we 
H(x,y,z) by solving another Pfaff’s equation in the variables u and z. 
that <3T/3x = 0 we use equation (7.11) and (7.12) and obtains 

0 8 . 

— (Xh - S) * u = — (Xf) 

8x dz 

a a 

— (Xh - S) = u * —(Xg) 

ay 3z 

a 3 

— (Xg) » u ■ —(Xf) 

0x 8y 

or (equation (7.14) written out in full) 

S x = hX x “ fX z + X(h x ' V 

“ Sy = gX 2 - hx y + x(g z - hy) 

0 - fX y - gX x + X(f y - g x ) 

Multiplying (7.15) by g. (7.16) by f and (7,17) by h and then adding up 
equations using condition (7.8) gives us 

gS x “ fS y “ 0 

Differentiating (7.13) with respect to x and y gives us 
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(7.12) 

z, we can 

(7.13) 

can f i nd 
To prove 


(7.14) 


(7.15) 

(7.1G) 

(7.17) 

the three 


(7.18) 
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S » T + T u 

X X U X 


S y " T u u y 


If we combine now (7*11), (7.18) and (7.19) we obtain: 

0 = gS x - fS y = gT x + gT u u x - fT u u y - 
« gT x + XfgT u - XfgT u - gT x 


(7.19) 


As g * 0 we can conclude that T x « 0. Thus we can rewrite (7.13) as 

S(x,y,z) * T(u,z) 

The equation (7.1), after being multiplied by X and with the expressions 
(7.11) and (7.12) used, reads now as follows: 

X(fdx + gdy + hdz) = u^dx + u^dy + (u z + T)dz * 0 

or equivalently 

du + T(u,z)dz ■ 0 (7*20) 

» 

This is again a Pfaff's equation in two variables which we know how to solve* 
Its solution is ^(u,z) = C. Thus the solution to (7.1) is 

H(x,y,z) * ^(u(x,y,z),z) * C 
which is one-parameter manifold. 

Finally we are ready to describe a method for finding a complete integral of a 

« 

general first order PDE F(x f y,z,p,q) » 0. 

The basic idea is that we can interpret the total differential of a solution 
z(x,y) of the PDE 

dz = pdx + qdy (7.21) 

as Pfaff’s equation in the variables x, y and z. To really do so we still have to 
express p and q as functions of x, y and z. Now assume that we can find two 


functions f and g such that if we set 
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p = f(x.y.z.a) and q = g(x,y,z,a) (7.22) 

(where a is an arbitrary constant) the PDE and condition (7.8) (with h s -1) 

fg z “ gf z ” f y + 9x - 0 (7.23) 

is satisfied. Then the solution to (7,9) is a one-parameter manifold, but as we 

have already built in a parameter a into the equation (7.9) the solution contains 

two parameters and is the complete integral. So we have to solve the problem of 

how to find such functions f and g. We need two equations to do so. Let us 

assume that somehow a function G(x,y,z,p,q) exists such that p and q (or 

equivalently f and g) can be expressed from the two equations 


F(x,y,z,p,q) - 0 
G(x,y,z,p,q) - a 


(7.24) 


(aside: thus F p G q - F G * 0). 

Now we want to assure that f and g obtained in such a fashion satisfy (7.23) 
identically in the three variables x, y and z. Differentiating (7.24) with 


respect to x, y and z gives us: 


F x + p x F p + g x F q = 0 G x + p x G p + q x G q * 0 

F y + Py F p + g y F q ' 0 G y + p y G p + 9y G q = 0 (7 * 25) 

F z + p z F p + d z F q =0 G z + p z Gp + q z G + 0 

After expressing p z> q z , py and q y from (7.2G) and plugging this expression 
into (7.23) we obtain the linear first order PDE for the function G 


F p G x +F q G y + (pF p + 9 F q )G z ** + P^Gp - (F y + qF z )G q = 0 (7.2G) 


He can solve (7,2G) with the method of characteristics. The appropriate 




system of characteristic equations is the same as the one for F {x,y* z f p f q) » 8 

dx:dy:dz:dp:dq « FpjF^: (pFp + qF q ) :~(pF z + F^): ~ (qF z 4- Fy) (7*27) 

But we need now only one integral of (7,27) - which is independent of F and 
contains at least one of the variables p and q. Such an integral is our desired 
function G. There will always be such an integral as the solution of 17,27) 
comprise a four-parameter family: 

Vj (x,y,z,p,q) = Cj i- 1,2,3,4 

The Vj are independent and at least one of them must contain either p or q. 

The just described method is due to Lagrange and Charpit. It has the 
advantage over the method of characteristics as described in section V in that we 
only need to find a single integral of (7,27) instead of finding the four- 
parameter family of curves. 

VIIL Initial-value problem for linear and quasi-linear PDE’s 

Now that we know how to find the general solution of a given first order PDE 
we will attack the problem to determine the constraints with which a particular 
solution can be found. 

He will consider the quasi-!inear PDE 

a(x,y,z)z x + b(x,y,z)z y * c(x,y*z) (BA) 

Lie now want to find the integral surface z(x,y) which passes through a given 
curve C in space (in the literature referred to as Cauchy’s problem). Clearly 
the following questions have to be answered: 
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1) What conditions on C are necessary such that this problem is solvable* 

2) When is such a solution unique. 

Let C be given by continuous di f ferent iable functions of a parameter t: x(t), 
y(t), z(t). Furthermore we will assume that the projection of C on the x~y plane 
(later referred to as Cg) does not contain double points - (without this 
constraint we obtain surfaces with self intersections, i.e* z is not everywhere a 
single-valued function of x and y, which implies that along the line of 
intersection p and q are discontinuous) - and that x t 2 + y t 2 * 0. Now to 
construct a solution of the PDE which contains C we lay through each point of C a 

characteristic curve whose equations depend now on two parameters; 

* 

X = x(s,t) y = y(s.t) z = z(s,t) (8.2) 

Note that the functions x, y, z are still continuous differentiable. To get the 


equation of the integral surface we have to eliminate the parameters s and t from 


the equations (8.2), i.e. we have to express s and t in terms of x and y. A 

* 

sufficient condition to do so is that the functional determinant A as specified 


in (8.3) does not vanish along the curve C. 


A = * s yt “ y s *t <8.3) 

taside; using the characteristic equations we can rewrite (8.3) 


as 


A = ay^ - bxj] 


Thus if A * 0 we can express z as a function of x and y and it is assured that C 

lies on the surface. The solution is also unique which follous from the 
following lemma; 


Each characteristic curve which has one point in common with an integral 
surface, lies completely on this surface. 

The proof of this lemma is the uniqueness theorem for solutions of ordinary 
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differential equations. 

The determinant A can be interpreted as the outer product of the two vectors 


x 


/ x 


s \ / t 

$1 “| ) and | 2 


\y s / \y t / 

uhich are the projections of the tangent and the characteristic direction on the 
x~y plane. In the special case when A vanishes along C these two directions 
coincide and we can deduce that C has one of the three properties listed below: 

1) C is a characteristic curve. 

2) C is the envelope of the characteristics, (called edge of regression) 

3) Cg is the envelope of the projections of the character i st ics on the x-y 


plane. 

Let us first discuss case 1). From A « 0 we get 


x t «t 


a b 

If we use x C t) and y (t) (from the equation for C) in z(x f y) 
equation has to hold along C: 


(8.4) 

then the following 


dz dx dy 

— z*-- + V c az * + bz y " c 

dt dt dt 

Or equivalently we can say that C satisfies the characteristic equations and is 
therefore a character i st i c curve. Obviously the solution of the PDE is not 
unique in this case. Actually in the case when C is a character i st i c curve there, 
exist infinitely many surfaces through C which satisfy the PDE , To see that 
just choose another curve C’ along which A vanishes and which has a point P in 
common with C. Now to construct the solutions through C # one lays the 
character i s t i c through every point of C'» in particular also through P, (i.e. the 
character i st ic curve through P is C). Thus an integral surface through C’ 
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contains C. In such a nay infinitely many integral surface can be constructed 

which contain C. They meet along the characteristic curve and we can say that C 
is a branch curve. 

One assumption ue had made should be stressed here again: we were looking for 
solutions of the PDE which in the neighborhood of C are continuous and are 
continuous differentiable. It might be possible to find a solution z through C, 
along which A vanishes, without C being characteristic. These are the cases 2 
or 3 as mentioned above. But then the derivatives of z are not continuous on C. 
Let us illustrate this problem with an example. 


examp I e 

F(x,y,z,p,q) = 3(z - y) 2 p - q « 0 
characteristic equations: 

dx 

— = 3(z - y) 2 
ds 

ciy 

-- - -1 (*) 
ds 

dz 

-- « 0 

ds 


solution of (*} with initial values xg, yg, Zg: 

* - (z 0 - W0 + s) 3 + X 0 - (z 0 - y 0 ) 3 

y = - 3 + y 0 (**) 

z - z 0 

Ue want the solutions (**) pass through C given by: 

x * 0 y = t z = t 
Note that C is not a characteristic. 

So we set the initial values x 0 , y 0 , z 0 (i.e. x,y,z for s = 0) as 
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Xg * 0 yg « t 20 ® t 
With these initial values (**) becomes 

x = s^ 

y - -s + t 

z * t 

and the determinant A is in this case 

A = x s y t - x t y s - 3s 2 

Thus along the curve C (i.e. s = 0) A « 0 

But there is a solution of the PDE which passes through C: 

z = x^ 2 + y 

Note that p * l/3x~^^ does not exist along C (as x = 0 there). 

Now we will explain the previous example. To deduce from A ® 0 that C is a 
character i st i c curve we used the relat ion: 


dz dx dy 


-= 7 + 7- 

x *y 

dt dt dt 

(8.5) 


But (8.5) is based on the following lemma in analysis: 


Let G be a region in R^, f:G R. If the partial derivatives at c € G exist 
and are continuous in a neighborhood of c then f is differentiable at c. 

This lemma is not satisfied if C is an edge of regression or Cg is the envelope 
of the project ion of the character i st ic curves on the x~y plan@ f (cases 2 and 3 
in the above Iist). 

In the case of a linear PDE we can make some more statements about the 
solution if A vanishes along C. lie will show that in this case the integral 
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surfaces are cylindrical surfaces perpendicular to the x-y plane, i.e. that the 
solution is independent of z. The POE is 


a(x,y)p + b(x,y)q . c(x,y) 


RecaI I that A is defined as 


A = x s yt - x ty s 


Note that if A g (i.e. the partial derivative of A with respect to s) and A 
vanish along C, then A vanishes everywhere. (proof* existence and uniqueness 
theorem for ordinary differential equations.) 

Using the characteristic equations: 


we obtain for A 


x g = a 


y s = b 


(*) 


~ a s y t + ay gt - b„x A - bx . ■ 


’8"t 


St 


SB 


a Q y t + ab t - b s x t - a t b 


Differentiating a and b with respect to s and t and using relations {#) we get 


a. = 


a x * 


t 


a x a + a y b 


3 x X t + Vt 

b x a + b y b 


b 


b x x t + b 


y y t 


and then 


A s * (a x + b y )A 


He want to express x as a function of y and z, i.e. x - f(x,y) and so we assume 
that y s z t - z s y^. * 0 along C. Then ue will proceed showing that f - 0, which 
will prove that the integral surface z is a cylindric surface. 

Differentiating x with respect to s and t we obtain 


X_ ® f U + f 2 

ct i i V a ~r 


y s 


Z 9 


x t - Vt + f z 2 t 
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then 

A - f z <z 8 y t - z t y 8 ) 

from which it follows 


IX. Initial-value problem for general first order PDE's 

Ue have seen that the problem of finding a solution to a general first order 
POE is equivalent to solving the system of characteristic equations. Again ue 
are posing the question about what kind of constraints determine a solution 
uniquely. Clearly we need more than in the quasi-linear case, as now the the 
solutions to the characteristic equations form a three-parameter family of 
curves. So let C be a curve given by x(t), y(t), z(t) such that neither C nor 
its projection on the x-y plane have double points. Furthermore ue have to 
specify p(t) and q(t) along C such that the condition 

dz dx dy 

— = p— + q— 
dt dt dt 

and the PDE (5.1) (i.e. F = 0) holds identically in t. Ue say that the function 
x (t), y(t), z(t), p(t), q(t) define an initial integral strip denoted by Cj. 
From now on the procedure is very similar to the one for so I v i ng the initial 
value problem for a quasi-linear PDE . So through every element of Cj we lay a 
characteristic strip, which then can be written as x(s,t), y(s,t), z(s,t), 
p(s,t), q(s, t). To express the parameters s and t in terms of x and y we demand 

that 

A = x s y t - x t y s - F p y t - F q x t 
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does not vanish identically along the initial strip. Then z, p and q can be 
expressed in terms of x and y. He only have to make sure that p and q written in 
such a fashion are the partial derivatives of the integral surface z(x,y). Thus 
we have to shou that the quantities U and V 


U = z t - px t - qy t 
V = z s " P*s “ 


(9.1) 


vanish identically. As we have assumed that A * 0 ue can deduce from (9.1) and 


a 


0 " z t - z x x t - z 


y y t 


0 = Z - Z X - Z..Z., 

y x s y y 


that z x « p and z y = q. Recall now the characteristic equations: 


dx 

- = F. 


dy 

— = F 


ds 

ds 

ds 

Using the first two in the 

last we obtain 



dz dx 

«•«» a M 

dy 


ds ds 

q— 
ds 


dz 


which imp!ies V « 0. 
Now to prove U s 0: 


8U 

” = z st - P s *t - P x st - P S y t - P y st 

3s 


3V 

— = z 

at 


st ■ Pt x s ■ P x st - Pt y s - py s t 


(9.2) - (9.3): 


3U 3V 


3s 3t 


«s 


- ( Ps x t - Pt x s + y s y t - P^s* 


(9.2) 


(9.3) 


(9.4) 
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Taking into account the characteristic equations and the fact that V * 0 implies 
8V/3t » 0 ue can rewrite (9.4) as 


au 

-- - Pt F P + Pt F q + x t F x + yt F y + ( p x t + pyt )F z (3 ’ 5) 

9s 

But ue knou that the POE F = 0 holds identically in s and t. Differentiating F 
with respect to t: 


F x x t + F y yt + F z z t + F pPt + F q q t * 0 


( 9 . 6 ) 


(9.G) in (9.5): 

au 

- = - F U 

z 

as 

For any fixed t this is an ordinary differential equation for U as a function of 
s with the solution: 


s 

f- F 2 dS 

U(s) * U(0)e° 

As by assumption U(0) is zero, U vanishes everywhere. 

To summarize the previous results: given a curve x(t), y(t) f z(t) along which 
we also know p(t), q(t) such that 


dz dx dy 
-- ex p-~ 4 * q— 

dt dt dt 

F(x(t),y(t),z(t),p(t),q(t)) = 0 and A « F p y t - F q x t * 0, then there exists an 
unique integral surface through the initial strip. Ue get a unique surface 
because the solution of the characteristic equations is uniquely determined by 
* ts initia I values. 

The exceptional case when A = 0 along is analogous to the one discussed in 

the previous section: there are infinitely many integral surfaces through Cj if 
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and only it is a characteristic strip. Again ue can say that the characteristic 
curves are branch elements as on either side there can be another member of the 

family of solutions of the PDE uhile ue are assured that along C the first 
derivatives are continuous. 

If C! is only a focal strip along which A = 0, then it might be still 
possible to find an integral surface z through it. But analog to the 
quasi-! inear case, z will not have continuous derivatives. 

The last case we will discuss is if C degenerates to a point P with 
coordinates (x 0 ,y 0 ,z 0 ). Then the strip condition is identically satisfied for 
all p 0 and q 0 which also satisfy the PDE, i.e., for all p 0 and q 0 which determine 
the feasible tangent planes in P. Thus we can write p 0 and q 0 as functions of a 
parameter t. I f ue plug the quantities x 0 , y 0 , z 0 , p 0 (t), q 0 (t) in the PDE we 
obtain an integral surface which is in this case a conical surface with vertex at 
P. It is called the integral conoid of the partial differential equation at P. 

It can be shown that the solution to the Cauchy problem can also be found by 
constructing the appropriate integral conoids. The integral surface is the 
envelope of the integral conoids whose vertices lie along a given curve C. 


X. Summary 


In the preceding chapters we dealt 

continuous derivatives in all their 

finding a solution to a given FOPDE is 

differential equations. By imposing 

solution can be found. 

* 

But recall that our motivation for 


with FOPDE*s which are continuous and have 
variables. Ue showed that the problem of 
equivalent to solving a system of ordinary 
"suitable” initial conditions, a unique 

studying FOPDE*s was to be able to solve 

$ 
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the image irradiance equation; 

R(p,q) * L(x*y) (10* 1 > 

This equation has two properties which we are going to exploit. First the 
function z does not appear explicitly in the equation and therefore no singular 
integral surface exists. Second the equation can be written as the difference of 
two functions, where one depends only on p and q whereas the other depends solely 
on x and y, Ue will use this fact to deal with discontinuities. 

Let us first review the case when (10,1) is a linear equation (note that 
(10.1) cannot be quasi -1inear!) f i.e; 

p + q « L (x, y) 

Ue assume that L (x, y) is continuous and has continuous first derivatives. Let C 
be an initial curve given in parameter form; x * x(t), y * y(t) and z * z(t). 
If the A (as defined in section VIII) does not vanish along C, then we have a 
unique solution. It is continuous and has continuous derivatives if C is a 
continuous di f ferent iabie function of the parameter t, "Any singularities of the 
initial data propagate in the x-y plane along the projection there of the 
relevant characteristic curve [GARG4]." This is not surprising as characteristic 
curves can be viewed as branch curves in which two integral surfaces meet. Note 
also that higher order derivatives may be discontinuous along characteristic 
curves. 

In the case when C or its projection onto the x-y plane has double points, the 
integral surface has self intersections, i.e. z is not a single-valued function 
of x and y. This is not a case of interest for us, as we can "see" only one value 

r 

of z. Note that a Mobius-str ip is not a contradict I on to the above assertions, as 
it is not an opaque object. In a case like that of a flobius-strip mutual 
illumination and shadows are essential for deducing the shape of the object. 

If A vanishes along C, then C is either a characteristic curve and we get 
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infinitely many solutions or we get a solution 
continuous along C. This second case is of special 
could specify such a C. This would imply that there 
we do not see, as it is neither reflected in the 
initial data. But luckily this cannot happen, 
characteristic equations are: 


whose derivatives are not 
interest to us. Assume we 
is for instance an edge which 
equation itself nor in the 
In the linear case the 


x s - 1 and y 8 « ±1 

Thus for A to vanish x t = y t which is equivalent to saying that x(t) and y(t) 
have to satisfy the characteristic equations. 


Now we will discuss the general image irradiance equation. Again we will 
assume that R(p»q) and L(x,y) are continuous and have continuous first 
derivatives. In deriving the system of characteristic equations we assumed that 
the integral surface z also has continuous second derivatives [we used this fact 
in equation [5.10] to deduce that p y = q x J. In [f1Y48, PLI54) it was shown that 
an integral surface can be build from characteristic strips also in the case when 
only the first derivatives are continuous. 

He want the integral surface to pass through a curve C again given in 
parameter form by x = x(t), y = y(t) and z = z(t). Then we can determine p(t) 
and q(t) along C by solving the two equations: 

R(p(t),q(t)) = L(x(t),y(t)) (10.2) 

dz dx dy 

— = p(t)— + q (t) — (10,3) 

dt dt dt 

which we consider here to be algebraic (not differential) and solved over the 
reals. As (10.2) is nonlinear, we may get zero or several solutions for p(t) and 
q(t). Thus only for a unique determination of the roots of the equations (10.2) 
and (10.3) and the assumption that A * 0 along C do we get a unique integral 
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surface. Recall that in the linear case two integral surfaces intersect smoothly 
(i.e. have the same tangent plane along their intersection) only along 
characteristic curves. In the general case this can also happen along the curve 
where the transition from one root of p and q to another takes place* To 
simplify the following discussion we will assume that p and q are given along C, 
such that equations (10.2) and (10.3) are satisfied. In other word the initial 
data is an initial strip denoted by C^. Again discontinuities in the initial 
data propagate into the solution. It was shown [HA281, that if the initial data 
does not have continuous second derivatives, then the solution does not have 
continuous first derivatives. To understand this fact, recall the lemma of 
Schwarz? 


2 

Let G be a simply connected region in R , f:G -» R. If f » f 


x' y 


f ex t 
xy 


and are continuous, then f exists and f = fy X - 


Furthermore for p and q to be the partial derivatives of z, they have to satisfy 
the above lemma. Thus if the initial data does not have continuous second 
der i vat i ves, then the lemma of Schwarz is not satisfied along Cj, which implies 
that p and/or q are discontinuous. 

The case A = 0 is analogous to the linear case. If Cj is a characteristic 
strip, then we get infinitely many solutions. Again we pose the question whether 
it is possible to specify Cj such that A = 0 and is not characteristic. Then 
the derivatives of p and/or q would be discontinuous along C (which by the 
preceding remarks implies that the first derivatives are discontinuous). In that 
case C would be a focal curve, i.e. satisfying the equations 

dx dy dz 

- , R p - = R q - = pR p + qR q U8.4) 
dt dt dt 
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but 

dp dq 

* L*(x(t),y(t)) and — * L (x(t).y(t)) (10.5) 

dt dt 9 

This cannot occur as we assumed that the function L(x,y) is continuous and has 
continuous derivatives. Thus if x(t) and y(t) satisfy (10.4) they also have to 
satisfy (10.5) as L x and depend only on x and y. 

The last case we have to be concerned is when A vanishes only along parts of 
C [LER57J. But then C cannot be a continuous differentiable function and the 
solution is going to have discontinuous derivatives. 

He always assumed that C is not a closed curve, as this would either 
overdetermine the problem or make it inconsistent. 


XI. Open questions 


Very little is known about "singular" POE's, i.e. equations which are not 

continuous in all their variables. Again some literature, e.g. [HAD28]' can be 
found about singular second order PDE’s. 

In the case of the image irradiance equation we are concerned about 
singularities which occur in the equation itself. He can always assume that 
R(p,q) is continuous in p and q. A case when R(p,q) is not continuous is when the 
surface contains specular!ties, which can be represented by delta-functions. 
Then a completely different approach has to be taken to solve the equation. But 
in a lot of cases L(x,y) is going to be discontinuous. As an example we use the 
following situation: looking through an electron microscope on a half-sphere 
lying on a flat surface which can be formulated as: 




2 2 
p + q *= 


2 . ,.2 

x + y 
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1 - (* 2 + y 2 ) 

Along the contour >? + * 1 the equation is discontinuous* In this case the 
contour is called an occluding contour* Informally we can say that if L(x,y) is 
discontinuous then the derivatives of the integral surface are going to be 
discontinuous. By specifying the solution along the curve C* where the 
discontinuity occurs, we can still find an integral surface. As z does not 
appear explicitly in the equation, only the projection of C’ onto the x-y plane 
can be found directly from the equation. Rigorous proofs of these claims are 
going to appear in a subsequent paper. 

I4e always assumed that the integral surface is continuous. Discontinuities 
in z correspond to gaps and for these kind of situations the image irradiance 
equation is inadequate. 

Another open problem is how to deal with discontinuities in the image 
intensity gradient, i.e. discontinuity in L x and/or Ly* To be able to integrate 
the characteristic equations we had to assume that the first derivatives of L and 
R are continuous. He conjecture that the case of discontinuities in the first 
derivatives can be treated in an analogous fashion as the cases of 
discontinuities in the functions themselves. 

The image irradiance equation describes some of the important features of the 
Veal" world. There is evidence that human beings deduce a lot of information 
about the shape of an object by looking at its contours and registering the 
"grey" levels. Ue discussed how these two pieces of evidence are tied together 
in a single partial differential equation.. 
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